1 link tagged with all of: classification + inference speed + openai + ai
Click any tag below to further narrow down your results
Links
OpenAI released the Decisions API in public beta, which makes classification and decision-making tasks roughly 10 times faster than their Responses API. The tradeoff is higher cost per request and currently no token caching support, which some developers find economically unattractive for certain use cases.
- Decisions API processes text and image inputs to return typed answers (probabilities, choices from sets, rubric scores) about 10x faster than the Responses API, with median response times around 0.3-0.8 seconds on typical connections
- Accuracy is comparable to Luna (the model used in Responses API) but slightly faster and more variable in performance, though the practical difference is negligible
- No token caching is currently available, making the API more expensive per request than alternatives for repeated classification tasks—a limitation developers hope gets addressed soon